Effect of synaptic plasticity in the structure and dynamics of disordered networks of 

coupled neurons 
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In an all-to-all network of integrate-fire oscillators in which there is a disorder in the intrinsic 
firing rates of the neurons, we show that through spike timing-dependent plasticity the links which 
have the faster oscillators as presynaptic, tend to be strengthened while the links originated from the 
slow spiking neurons are weakened. The emergent effective flow of directed connections, introduces 
the faster neurons as the more influent elements in the network and facilitates synchronization by 
decreasing the synaptic cost for onset of synchronization. 

PACS numbers: 87.19. lr, 87.19.1g, 87.19.1m 



Experimental studies indicate that excitatory synapses 
are very sensitive to the temporal order of firing of pre- 
and postsynaptic neuron^. A synaptic efficacy with spike 
timing-dependent plasticity (STDP), is found to increase 
if firing of a presynaptic neuron occurs in advance of firing 
of a postsynaptic neuron, and to decrease if the tempo- 
ral order of firing is reversed^. Indeed, STDP is widely 
thought to underlie learning processes, and in itself con- 
stitutes a broadly interesting phenomenal. 

The vast studies on synchronization both in the scale 
of few neurons and in large networks, reveals that with 
STDP neural synchronization is more rapid and robust 5 . 
Comparing to networks of fixed coupling strength, in 
the networks in which the couplings change according to 
STDP, the regions of synchronization in the parameter 
space are wider, e.g. they can suffer larger mismatch in 
intrinsic frequencies yet showing synchronized behavior. 

While most of the early studies on synchronization 
properties of the complex networks ignore the evo- 
lution of network structure and the directionality of 
the links, recent studies address both the effect of 
the links directionality 6 - - — and time-dependent coupling 
strengths^. When networks are directed, the Jacobian or 
Laplacian matrices will have complex eigenvalues which 
influences both the stability-ii and the dynamical orga- 
nization of complex networks 6,9 . Here we study how 
STDP changes the structure of the directional links of 
a neuronal network, in an initially (topologically) ho- 
mogeneous network consisting of nonidentical oscillators. 
Starting with an all-to-all network with symmetric cou- 
plings, we will show that disorder in the intrinsic firing 
rates leads to asymmetric couplings in a predictable man- 
ner, i.e. the evolution of the network is such that the 
influence of the neurons (strength of outgoing couplings) 
with higher rate of activity is enhanced and in turn, the 
strength of incoming coupling to the slow neurons is in- 
creased. Then we show the coupling cost for the onset of 
synchronization for such a network, which has an effec- 
tive network flow of the directed connections from fast 
to slow components, is smaller than that of a symmetric 
network^. So in a network of constant sum of the node 
strengths, such effective flow of connections leads to more 
organized dynamics. In turn we show the evolution of the 



synaptic strengths in the network depends on whether or 
not synchrony is achieved through STDP. 

The model network consists of N pulse-coupled non- 
identical oscillators, each of them defined by a linear first 
order equation: 



dVj_ 

dt 



(0.1) 



in which Vj is a voltage like variable for each neuron la- 
beled by j — 1, 2, N, t — 1 is the time constant. Every 
time a threshold value v t h = 1 is touched, neuron fires 



and the voltage resets to v r 



0. is the external 



excitation (current) and Jy is synaptic current with the 
neurons i and j as the pre- and post-synaptic neurons, 
respectively. The spike are recorded by the neuron re- 
sponse function^ defined as Xj(t) = S(t — i™ 1 ) where 
tj 1 is m th time when the neuron j fires and 6(x) is the 
Kronecker delta function. The synaptic current 2y is 
defined as 



Ilj ay Qij Xi(tj , 



(0.2) 



where ay is the element of the adjacency matrbsi^ which 
is one when there is a direct connection between the neu- 
rons i and j as the pre- and post-synaptic neurons and 
zero otherwise. With ay = 1 neuron j receives a kick 
by the strength ay every time neuron i fires. Synaptic 
strength ay is positive throughout this study to model 
excitatory synapses. For later convenience we call the 
matrix formed by the elements ay fly weighted adjacency 
matrix. 

With the minimal model we used, with the equal time 
constants of the neurons, inhomogeneity in the intrinsic 
activity rates is imposed by choosing the external cur- 
rents Ij from a distribution, note that this could also 
be imposed by choosing neurons with different time con- 
stants and equal feeds. Distribution of the firing rates can 
then be calculated using the relation of the firing rate of a 
LIF neuron to input current as r = [r In (//(/ — Vth))]~ ■ 

The time-dependent synaptic coupling strength gy 
changes depending on the dynamics of the presynaptic 
and postsynaptic neurons. Through STDP gy changes 
by Agy, which is a function of the time difference At = 



2 



tj — ti between the times of postsynaptic and presynaptic 
spikes. Synaptic modification Ag^ is provided by 



A 9ij = A±sgn(At)exp{-\At\/T±), 



(0.3) 



where the parameters r + and t_ determine the ranges 
of pre-to-postsynaptic interspike intervals over which 
synaptic strengthening and weakening occur. A+ and 
A—, which are both positive, determine the maximum 
amounts of synaptic modification which occur when At 
is close to zero^. A + (A-) and t+ (t_) are used when 
At is positive (negative). Since the additive STDP is 
used, divergence of the synaptic strengths is prevented 
by assuming limiting values for the synaptic strength. 

It is noted before by Gilson et al that symmetry of 
the coupling matrix is broken by STD P 14 i 15 . We study 
how is the possible effect of such asymmetry on the dy- 
namics of the network and how the dynamics in turn 
affects the structure of the connections in the network. 
We first define the synaptic cost as the sum of the all 
synaptic strengths in the array. To quantify the asym- 
metry, we define link imbalance as the difference of the 
synaptic strengths between two nodes CV, = ~Cji — 
a ij9ij ~ a ji9ji- Furthermore, we introduce the strength 
of the node as the sum of the all the incoming synap- 
tic strengths, the synapses which have the neuron j as 
the post-synaptic CJ = Y^% a ij9ijl an d sensitivity of 
node as the outgoing synaptic strengths, those which 
have the neuron j as pre-synaptic Cj — a^gji. This 
sums can also be interpreted as the sum of the ele- 
ments of jth column and jth row of the weighted ad- 
jacency matrix, respectively. We call the difference be- 
tween the outgoing and incoming synaptic strengths for 
each neuron Cj = — CJ as the node imbalance. 
A positive node imbalance means the neuron's outgo- 
ing synapses are stronger than its incoming synapses 
and vice versa. Also introducing network imbalance as 
C net = 1 /N 2 Y*,i j sign(i — i)Cy , we can deduce that the 
mean strength of the fast neurons is larger than their 
mean sensitivity if C ne t is positive and vice versa. We 
will show later that STDP can increase network imbal- 
ance but before, we inspect effect of predetermined net- 
work imbalance on the dynamic of a network with static 
synapses. 

We construct a fully connected network (ay = 1 for 
every i and j) with the link imbalance as a variable 
parameter, assuming the synaptic strengths as — 
l/N[go + r\ sign(i — j)f(\i — with constant go and 
/(£) a monotonically increasing function of £. Then the 
link imbalance CV,- = 2rj sign(i — j) f (\i — j\) and the net- 
work imbalance can be controlled by the parameter rj. 
The external currents are chosen equally spaced in the 
interval [Iq — S, Iq + S] , and the neurons are labeled in 
order of increasing input current, i.e. the j = 1 neu- 
ron has the smallest input and so on. There are two 
points worth noting: first since the nodes are labeled in 
order of increasing intrinsic firing rates, the two neurons 
with larger difference in intrinsic firing rates have a link 
with larger imbalance. Second, sum of the all synaptic 
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FIG. 1: (a) The order parameter, the amplitude of the net- 
work activity as a function of parameter of imbalance. In a 
network of N = 64 neurons with all-to-all connections, input 
currents are chosen as Ij = 1 + O.OOlj and synaptic strengths 
astfe = l/JV[.08 + i7 sign(i-j)f(\i~j\)] with /(x) = . 
The range of n we have studied is such that all the synaptic 
strengths are positive. Increasing n beyond this range results 
in negative synaptic strengths which we do not consider here. 
In (b) and (c) the network activity is shown for two different 
values of imbalance parameter: periodic behavior of the net- 
work activity with relatively large amplitude in (c) indicates 
synchrony of the neurons. Inset of (a) shows mean firing rate 
of the neurons in the network vs. parameter of imbalance. 



strengths in the network remains constant (equal to go) 
when changing imbalance parameter r\. 

Now we inspect how the dynamics of the network is 
affected by changing imbalance parameter. The network 
activity is defined as the average response functions of 
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all the neurons in the array X net {t) = l/iVJ^ x jif)- I* 1- 
phase firing of the large fraction of neurons in the array 
leads to oscillatory behavior of the network activity func- 
tion with large amplitude, so the amplitude of the net- 
work activity function can be used as an order parameter 
showing how synchronized are the firing of the neurons in 
the network. In Fig. la we have shown how the order pa- 
rameter changes when we increase the imbalance parame- 
ter in a network with constant sum of the couplings. The 
plots show that the neurons can be synchronized when we 
increase the strength of fast neurons and decrease their 
sensitivity. It is also shown negative imbalance has no ef- 
fect on the coherence of the behavior of the neurons, i.e. 
they are outgoing synapses from the fast neurons which 
should be strengthened to achieve synchrony. It is also 
shown in the inset of Fig. la that mean firing rate of the 
array increases with imbalance parameter, which is a rea- 
sonable consequence of the increase of strength of faster 
neurons. In such a system synchrony can be interpreted 
as the triumph of the fast components to dictate their 
dynamics on the slower neurons; increase in the strength 
of the fast component (meanwhile the sensitivity of the 
slow components increases) leads to increase of both the 
mean firing rate of the network and the degree of syn- 
chrony. 

We now let the synaptic strengths to evolve through 
STDP, and investigate how the initial synaptic strengths 
and consequent possible organized dynamics of the net- 
work can affect the evolution of the structure of the 
network. Again we consider a fully connected network 
with initially equal symmetric synaptic strengths. We 
assume antisymmetric STDP profile with usual criterion 
(A + > A- and A + t + < A_r_) with zero lower cutoff. 
We examine two situations: in both of them the initial 
synaptic strengths are not enough to overcome disorder 
in the array and the neurons are unsynchronized when 
STDP is absent. Asymmetry induced by STDP in one 
of the experiments leads to synchrony where in second 
experiment the neurons remain unsynchronized in the 
steady state as is shown in Figs. 2 and 3. 

When STDP leads to synchronized firing of the neu- 
rons (Fig. 3), a net synaptic flow is constructed from the 
fast to the slow neurons, which is reflected in the value of 
network imbalance as it takes positive value in the steady 
state. The positive network imbalance indicates most of 
the weakened synapses are those from slow to fast neu- 
rons and most of those which are strengthened, are from 
faster neurons to slower ones. With the parameters we 
have chosen the synaptic cost of the network decreases; 
this is of great importance since synchrony is achieved 
despite of such a decrement in the synaptic cost. This 
is consistent with the above result which imbalance low- 
ers the synaptic cost for onset of synchronization. We 
mention here that the evolution of synaptic cost is de- 
pendent to the choice of parameters of STDP and with a 
minor change of parameters, synaptic cost may increase. 
But nevertheless, when the final state of the network is 
synchronized network imbalance increases. We note here 
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FIG. 2: In (a) the network activity is shown when the synap- 
tic strengths evolve through STDP. The boosted amplitude of 
activity is due to transition of the network to oscillatory state 
which indicates synchrony in the array. In (b) evolution of 
the network imbalance is shown. Inset shows the evolution 
of the network cost, sum of the all the synaptic strength in 
the network. The currents are chosen as Ij = 1 -+- O.OOlj, 
lower and upper cutoffs are zero and 0.16/iV, respectively 
with the network size N = 64. The initial couplings are all 
equal to 0.08/JV. Parameters of STDP are A+ = 0.000055, 
A- = 0.000050, r+ = 10 and r_ = 15. 



that although asymmetry induced by STDP has been re- 
ported before^, with the differences in intrinsic rate of 
firing of the neurons, asymmetry is established such as 
a net structural flow of the weighted links (from fast to 
slow neurons) is created in the network. In the other 
experiment in which smaller values are chosen for the 
initial synaptic strengths (while keeping the upper cut- 
off unchanged), the plasticity can not lead to synchrony 
(Fig. 3). In this case the time course of the network im- 
balance is dependent to the initial condition and it can 
choose both positive and negative values. 

We have repeated a similar experiment with the 
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FIG. 3: The network activity (a), the evolution of some of 
the synaptic strengths (b) and the evolution of the network 
imbalance are shown for the same network as Fig. 2 with 
smaller initial synaptic strengths. All the parameters are the 
same as Fig. 2 except for the initial couplings which here are 
all equal to 0.04/JV. Inset shows the evolution of the network 
cost, sum of the all the synaptic strength in the network. 



Hodgkin-Huxley neurons with chemical synapses (see ap- 
pendix), to inspect whether the results are applicable in 
the more biologically plausible models. As is shown in 
Fig. 4, role of STDP is to decrease the effect of dis- 
crepancy in the intrinsic firing rates and organize the 
dynamics of the neurons. In turn, emergent structure 
of the network is shown in Fig. 5 where a nearly trian- 
gular weighted adjacency matrix is formed and network 
imbalance is reasonably increased. 

In passing we show that for two weakly connected, 
non-identical neurons with excitatory couplings, both in- 
creasing the strength of the fast neuron and decreasing 
its sensitivity enhances domain of synchronization. In 
other words such asymmetric connection can lower the 
threshold for onset of synchronization. We consider two 
neurons with the inputs I 2 = h + S which are connected 
by two directed couplings with the strengths gi2 and 321 • 
With positive mismatch parameter S > the second neu- 
ron is the faster. Looking for existence criterion for the 
inphase 1 : 1 synchronization, we consider the two cases 
in which one of the neurons (master) fires and makes also 
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FIG. 4: Membrane voltages of the sample neurons is given 
in two different times in initial (upper plot) and steady state 
(lower plot), the parameters of the HH neurons and synapses 
are given in the appendix. Other parameters are A+ = 9ns, 
A- — 8.6ns, t + = 20ms and t_ = 30ms. 
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FIG. 5: In a network composed of Hodgkin-Huxely neurons 
and chemical synapses, the initially symmetric the weighted 
adjacency matrix (a), evolves to a nearly triangular matrix in 
the steady state (b). In (c) the evolution of network imbalance 
is shown. All the parameters are those of Fig. 4. 



the other neuron (slave) to fire. In first case we assume 
the faster neuron first fires at time U and the slower fires 
just after it i.e. the fast neuron is master and the slower 
is slave. With no refractory period firing of the slave neu- 
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ron changes the voltage of the master by 1712 and the fast 
neuron would fire again at time t i+ i — U + ln( / j-~_ 3 ^ 2 ). If 
at the time of firing of the master neuron the voltage of 
the slave neuron is larger than 1 — 321, it fires following 
the fast neuron, that is 

/i>(l-to)^. (0.4) 
1 -512 

Since we have assumed here the slave neuron is the slower 
one, it can not exceed the fast neuron and the above 
equation solely determines the existence condition for the 
inphase solution. Assuming I\ = I2 — S this equation de- 
termines the maximum mismatch which allows inphase 
I : 1 synchronization. The second case which as we will 
see is possible for large values of coupling constants, as- 
sumes that the slower neuron is the master. In this case a 
criterion similar to Eq. 4 exists and also we should pre- 
vent the faster neuron to exceed the slower neuron i.e. 
at the time of next firing of the master neuron ti+i the 
voltage of the fast neuron should be less than threshold. 
Putting together we get 

> h > (1 - 512)- ■ (0.5) 

1-521 1 - 521 

In the equations above two points are worth noting: for 
small values values of coupling constants which is matter 
of our study, just the synchronized state with fast neu- 
ron as the master can exist and this state can not be 
achieved with large values of strength of the slow neu- 
ron 512. In other words 521 appreciates synchrony and 
<7i2 opposes it when the state in which the fast neuron 
is dynamically master, is the only possible inphase state, 
that is, for small values of synaptic strengths. Although 
it can be shown for near threshold currents I{ ~ 1 + O(e) 
and small synaptic strengths ~ 0(e), effect of the 
512 is of order e 2 , but for larger input currents the effect 
of the strength of slow neurons can be comparable with 
that of fast neuron. With STDP for two weakly con- 
nected neurons, our results show that the strength of the 
fast neuron always increases and that of the slow neuron 
decreases and as noted above both of them appreciate 
synchrony. When synchrony is achieved (with the fast 
neuron as the master), the rate of change of the synaptic 
strengths increases and they are then just limited by the 
cutoffs considered in the model. 

To conclude, we have shown that in the systems 
of weakly connected neurons with excitatory synapses, 
when there is a mismatch in the intrinsic firing rates of 
neurons, a special asymmetric arrangement of synaptic 
constants can enhance synchrony. In this arrangement 
directed links from the faster elements to the slower ones 
should be stronger. In a two neuron system, this re- 
sult is verified by a simple analytic reasoning. We have 
also showed that spike timing-dependent plasticity in 
such disordered networks, can organize the firing of the 



neurons by imposing such asymmetry on the matrix of 
synaptic strengths. In turn, the emergent structure of the 
synapses in the presence of STDP depends on weather or 
not synchrony is achieved in the network. 

Appendix A: The Hodgkin-Huxley model and 
chemical synapses 

The membrane voltage of the neuron in the Hodgkin- 
Huxley (HH) model is described by^: 

C-jjr + Ina + h +k+ Iij = I 3 ■ (Al) 

c is the capacitance per unit area of the membrane which 
is taken as \\iE '/cm 2 and Ij stands for the external cur- 
rent. = gi(vj—Ei) is the passive leak current and I na — 
gnam 3 h(vj — E na ) and Ik — gkn A {vj—E}~) are sodium and 
potassium currents respectively, gi = 0.3mS/cm 2 is the 
conductance for the leak current and g na = 120mS / cm 2 
and gk = 36mS '/ cm 2 are the maximum conductance 
for the sodium and potassium ions, and E\ = l0.6mV, 
E na = H5mV and Ek = ~l2mV are reversal voltages 
for the leak, sodium and potassium currents respectively. 
rtij (hj), activation (inactivation) variable of sodium and 
rij , activation variable of potassium obey the differential 
equations: 

— ^- = a m (l - rrij) - p m mj, 

^Tjp = a h {\ - hj) - f} h hj, 

-± = a n (l - rij) - {3 n n 3 , (A2) 

where a and j3 are functions of membrane voltage as can 
be found in [16]. 

With the chemical synapses the synaptic current is de- 
scribed by Iij = •-,,•:/ - r){vj - E syn ) where 
is the synaptic maximum conductivity and E syn is the 
synaptic reversal potential. Sij (t) is the synaptic activity 
function defined via: 

dsi 

-JjL = af(vi - v th ){l - Sij) - f3sij, (A3) 

with a and /3 defining the activation and deactivation 
time constants, Vth = 20mV is the threshold voltage for 
the activation of the synapse and / is the threshold func- 
tion f(x) = 1/2[1 + tanh(5x)]. 

The parameters we have chosen are such that with 
lext = 0, the resting potential of the neuron is zero; 
so the choice E syn — SOtoV^ is reasonable for excita- 
tory neurons. Inspired by typical time constants of the 
activation and deactivation of excitatory synapses with 
AMPA-receptors, we have chosen a — 10 and (3 = 0.5 
as the activation and deactivation time constants for fast 
synapses^. 
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